Search for: All records

As online learning platforms become more ubiquitous through- out various curricula, there is a growing need to evaluate the effectiveness of these platforms and the different meth- ods used to structure online education and tutoring. To- wards this endeavor, some platforms have performed ran- domized controlled experiments to compare different user experiences, curriculum structures, and tutoring strategies in order to ensure the effectiveness of their platform and personalize the education of the students using it. These experiments are typically analyzed on an individual basis in order to reveal insights on a specific aspect of students’ online educational experience. In this work, the data from 50,752 instances of 30,408 students participating in 50 differ- ent experiments conducted at scale within the online learn- ing platform ASSISTments were aggregated and analyzed for consistent trends across experiments. By combining com- mon experimental conditions and normalizing the dependent measures between experiments, this work has identified mul- tiple statistically significant insights on the impact of var- ious skill mastery requirements, strategies for personaliza- tion, and methods for tutoring in an online setting. This work can help direct further experimentation and inform the design and improvement of new and existing online learning platforms. The anonymized data compiled for this work are hosted by the Open Science Foundation and can be found at https://osf.io/59shv/.